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DIGITAL IMAGING SYSTEM FOR EVIDENTIARY USE 

DESCRIPTION 

BACKGROUND OF THE INVENTION 

This application for patent claims priority from 
5 U. S. Provisional Patent Application 60/180,783 filed 

February 7, 2000. 

Field of the Invention 

The present invention generally relates to 
techniques for authenticating digital images, and in 
10 particular to techniques for encoding authentication 

information and distributing that information 
throughout the image. 

Background Description 

Digital cameras offer high-resolution immediate 
15 imagery which can be processed and transmitted 

electronically without the need for scanning and 
digitizing a hard copy photograph. The digital 
nature of the resulting imagery, however, makes it 
more vulnerable to undetected manipulation in whole 
20 or in part. Where the imagery has evidentiary use, 

it is essential to incorporate a technique by which 
to determine that an image has not been altered. 
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Since it- is often essential to know the precise 
date, time, and location where the image was taken, 
what imaging device was used, and who took the image, 
the apparatus and method of the present invention use 
5 an encoding of that information distributed 

throughout the image as a secure means of providing 
that information as well as a certificate of 
originality . 

The method and apparatus of the present 

10 invention does not require the use of 

FlashCorrelation®. However, that technique provides 
a computationally simple and therefore rapid 
capability for decoding the two-dimensional encodings 
of data which provide authentication- Furthermore, 

15 FlashCorrelation® is fast enough to exhaustively 

consider all possibilities when certain encoded 
information is unknown, such as the ID of the 
specific camera used, the ID of the user, or the 
frame number or exact time of day a given image was 

20 taken. Alternately, steganography can be used. 

Presence of a Flash Correlation® Artifact (FCA) 
between a Resultant Image and an encrypted 
representation of the Encoded Data Array is 
sufficient to identify its date/time, location, and 

25 source. Each of those values can be separately 

identified, or all can be simultaneously verified. 
Presence of an FCA between a Resultant Image and an 
Encrypted version of the Original Image indicates 
that the Resultant Image is authentic. It is not 

30 necessary to decrypt the Resultant Image or to 
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perform pixel by pixel comparison in order to 
authenticate the image. Authentication of an image 
can be performed in one operation, regardless of the 
complexity of the image. 
5 Confirmation of the camera ID, the date/time, 

and the location can be separately made, with or 
without being cued by annotation on the image. 

Multi-colored or multi-grey level images can be 
similarly authenticated. Their complement is created 
10 by inversion of the grey scale or color chart. 

Alternately, colored images can be broken into 
components and represented by three layers of grey 
scale values, each of which is separately encoded and 
encrypted. 

15 SUMMARY OF THE PRIOR INVENTIONS 

"Flash Correlation®" refers to the instantaneous 
indication of massive correlation between two or more 
images through the process of overlaying two images, 
with one rotated and either inverted or not inverted 

20 with respect to the other, so as to produce a region 

with density statistically higher or lower than the 
rest of the overlaid image area, when and only when 
there is sufficient similarity between the two 
images. The two images may be scrambled prior to 

25 being overlaid in order to produce a more uniform 

density distribution. When pixelized images are so 
scrambled and there is strong correlation between the 
two images, the resulting FlashCorrelation® Artifact 
will be a square centered at the point of rotation. 
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Flash Correlation® Artifact (FCA) means a region 
of statistically different density, which may be 
repositioned within the overlaid area by relative 
translation of the two overlaid patterns having 
5 relative rotation. The existence of the FCA 

correlation artifact serves to: authenticate that an 
unknown pattern is included within a set of known 
images and identify matches between unknown and known 
specific images. Analysis of the FCA density 

10 provides a quantitative measure of the correlation 

between any two images. 

The use of FlashCorrelation®-generated patterns 
for authentication of documents and other images was 
included in patent 5,583,950 point of novelty # 21. 

15 "By utilizing either pseudorandom-generated patterns, 

or read-af ter-write random patterns, 
FlashCorrelation® offers the ability to overlay 
additional patterns as an item advances through a 
manufacturing or distribution cycle. The total 

20 composite pattern, or any of the subpatterns can 

subsequently be authenticated or identified. 

In the present invention, the Encoded Data Array 
may be added to the Original Array either before or 
after encryption. If before, then the Resultant 

25 Array must be decrypted prior to using 

FlashCorrelation® to authenticate the image and 
decode the data. This makes the image available in 
the clear during authentication and decoding. If the 
Encoded Data Array is added after encryption, then 

30 FlashCorrelation® can be used to authenticate the 
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image and decode the data without decrypting the 
image . 



SUMMARY OF THE INVENTION 



The present invention is an Evidentiary Imaging 
5 System (EIS) and is comprised by two subsystems: the 

Imaging and Encoding Subsystem and the Receiving and 
Authentication Subsystem- Transmission of the 
information between the two subsystems can be via any 
method for electronic or physical transfer. 

10 In the primary embodiment as an enhancement to a 

digital video camera, the EIS Imaging and Encoding 
Subsystem includes: a digital imaging sensor, a GPS 
receiver, a Greenwich Mean Time receiver, the camera 
ID, a frame counter and an encoding generator. The 

15 resultant system collects in real time the date, 

time, and location in which an image is captured. It 
encodes that information into the image. It may also 
annotate the information onto the image in 
alphanumeric format if the user selects that option. 

20 The encoding scheme uses a camera ID code that is 

different for each camera, and another code which is 
different for each frame of imagery taken with that 
camera. Therefore the encoded information changes 
with the particular camera used, as well as with the 

25 date, time, location, and frame number. The 

subsystem may also incorporate a biometric technique 
which permits only an identified and authorized user 
to operate the system, or which encodes the identity 
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of the camera user along with the other encoded 
information, or both. 

In the primary embodiment, the EIS Receiving and 
Authentication Subsystem includes: an image receiver, 
5 annotation detection and readout capability, 

decryption, decoding, and authentication, followed by 
restoration of the image. A decision output is also 
included to display or otherwise transmit the results 
of the authentication test. 

10 The present invention also provides a method for 

authenticating digital images. The image is 
captured, and then authentication information is 
recorded at the time and place of capturing. This 
authentication information is unique to the digital 

15 image and includes at least one piece of information 

from a source independent of the capturing process, 
such as GMT and/or GPS information from satellites. 
The authentication information is encoded into a data 
array in a manner which can be mapped to the digital 

20 image, thereby creating a composite array. 

Optionally, the composite array can be encrypted and 
annotated. Then, in order to authenticate whether a 
target composite array is an authentic copy of the 
composite array, the data array of authenticating 

25 information is compared to the target composite 

array . 

Various approaches may be used for the encoding 
and encryption functions within the EIS. The camera 
ID can be encoded in hardware by placing dots on the 
30 lens, by modifying the pixels in the detector array 
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(effectively creating a number of "bad pixels") or 
other hardware or software techniques. The frame 
counter, and the input from the GPS and GMT receivers 
are encoded via software. The resultant from the 
5 encoding steps is an array of pixels called the 

Encoded Data Array. 

The Encoded Data Array can be a binary array 
which is superimposed on the Original Image Array, 
being logically "OR'd" with it. Alternately, pixels 

10 in the Encoded Data Array can be grey scale or color, 

and can be added, subtracted, or used to replace the 
corresponding pixels in the taken image. The 
simplest and primary embodiment uses binary Encoded 
Data Array pixels which are logically OR'd with the 

15 Original Image Array . The resulting image is called 

the "Composite Image". 

The Composite Image can be scrambled or 
encrypted prior to storage or transmission. The 
resulting image is called the "Encrypted Composite 

20 Array". For simplicity, it is assumed that this step 

is always performed, but may include a "Null 
encryption" in which no change occurs to the 
Composite Image. 

Some or all of the information used to create 

25 the Encoded Data Array can be annotated onto the 

Encrypted Composite Array so as to be visible to the 
human eye or to sorting mechanisms. The resulting 
image is called the Annotated Encrypted Composite 
Array. For simplicity, it is assumed that this step 

30 is always performed, but may include a "Null 
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annotation" in which no information is annotated on 
the Encrypted Composite Array. The Encrypted 
Composite Array is the "Resultant Image" from the EIS 
Imaging subsystem. 
5 Resultant images can be transmitted, stored, 

printed, and otherwise distributed. However, any 
processing, including compression and expansion, will 
create alteration in the Resultant image. Additional 
subsequent processing will create further alteration. 

10 Processing of a part of the image will create 

detectable alteration in that part. 

Certain recipients may be given the ability to 
decrypt the Resultant Image but not the ability to 
decode the Encoded Data Array, 

15 Other recipients may be given the ability to 

extract the Encoding, or to authenticate one or more 
of the camera ID, frame number, date/time, location, 
and user ID, but not the ability to extract and 
authenticate all of them. 

20 Recipients who have the ability to extract and 

authenticate all of the parameters associated with 
the imagery are called Authenticating Recipients. 

Entities which are not users of the imagery may 
independently provide authentication services, which 

25 might include providing cameras, and analyzing 

Resultant Imagery. These entities or persons may 
serve as expert witnesses to testify to the 
authenticity of the Resultant Imagery, and explain 
the procedures in evidentiary proceedings. These 

30 persons are called "Certifiers". Among their duties 
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is determining the precision of the location and time 
information encoded on an image, and the statistical 
level of confidence in asserting that an image has or 
has not been modified; that is that it is or is not 
5 an authentic original taken at the encoded time and 

location by a particular camera and user. 

Certifiers are responsible for maintaining the 
encoding keys for each camera. They can be the 
camera manufacturers, the owner of one or more 

10 cameras, or any organization responsible for 

providing expert witness as to the facts surrounding 
the imagery ' s collection . 

The imagery collected by the camera can be in 
the normal visual band, or can be infrared, 

15 ultraviolet, x-ray, sonogram, or any medical or 

hyperspectral imagery producing a 2-D or 3-D digital 
image. Additional information can be input through a 
keyboard, scanner, or other means and be also 
encoded, including alphanumeric data such as the name 

20 of the photographer or subject. Alternately, the EIS 

can include a speech recognition module which 
translates spoken information into text for encoding. 

The EIS camera can be a video sequencer, which 
takes multiple images over an interval of time. The 

25 EIS encoding provides timestamping of each frame to 

document the timing of recorded events. The EIS 
provides tamper indicating secure transmission of 
imagery electronically via satellite, or RF, or 
landline or other communications network including 

30 the public telephone network. 



MIKOS-EIS 




10 



Rather than a camera, the EIS may use another 
source^ such as a scanner or computer software which 
produces a document or image. The output of this 
source is input to the EIS in place of the camera 
5 input. The EIS may be a component of a secure 

computer network and be automatically triggered by 
operations to a document or image such as; saving, 
transmission, printing, or duplication. The EIS 
Encoded Data Array would include a code which 

10 represents the terminal or workstation which 

originated the work or which is transmitting it. The 
work may have previously been encoded with other 
date, time, and source. Multiple sets of encoded 
layers may be applied without affecting the accuracy 

15 of the authentication. That ability to overlay and 

separately readout multiple layers is an important 
advantage of FlashCorrelation® . 

The Evidentiary Imaging System (EIS) has several 
important applications. These include providing: 

20 

Authentication of documents and images generated 
by computer and then stored, printed, or 
transmitted . 

On-the-fly secure encoding of date, time, and 
25 origination point of computer-generated 

products . 

Documentation of the date/time and location of 
crime scene photographs which are to be 
used for evidentiary purposes. 
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Insurance claim photographs of automobiles, 
houses, boats, or other damages with 
date/time, location and authentication 
features . 

5 Surveillance images triggered by intrusion 

sensors, electronic keys, door openings, 
etc. with automatic date/time and source 
information encoded prior to storage and/or 
transmission . 

10 Documentation of events such as the signing of 

a will or contract, with date/time, 
location, source, and authenticating 
features in every frame. 
Images of actual signatures on documents; 
15 providing automated date/time and location 

for electronic signatures. 
Archival Identity Photographs at ATMs, point 
of sale (POS) terminals, check cashing 
facilities, bank teller windows, or other 
20 locations of financial transactions. 

Documenting the condition of an item being 
sold "as is", including houses, cars, 
boats, furniture, carpets, etc. either 
using single frame or digital video 
25 imagery. 

Documenting the medical condition of a patient 
at admittance, or as indicated by any 
imaging sensor . 
Time clock records of employees entrances and 
30 exits from a facility. 
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Documentation of accesses to and time in 

hazardous areas. 
News event documentation indicating the 

authenticity of the imagery taken as well 
5 as the date/time and source. 

Accident reconstruction, when the EIS is 

installed for example in the front end of a 

vehicle or incorporated into its roofline, 

and is triggered by air bag activation. 
10 Traffic control cameras which are triggered by 

vehicle speed sensors or by motion sensors 

during red-light conditions - 
Recording of significant or record-breaking 

events such as at the finish line at 
15 racetracks^ or at checkpoints of a rally or 

long distance race - 
Recording absence of activity, or providing 

alibis at specific locations and times. 
Detecting altered images. 
20 Detecting unauthorized use of copyrighted 

images . 

Establishing ownership of disputed images. 

The EIS can also include additional memory and 
25 processing features. Any number of EIS units can be 

deployed to surveil an area to record and document 
events of interest. EIS units can be connected to a 
communications link in order to provide realtime 
information in a secure method to a central 
30 operations station. That central station can hold 
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the decryption and decoding keys to all the EIS, 
enabling it to authenticate and analyze the received 
imagery either in real time or with postprocessing. 
Ancillary benefits provided by the EIS include 
5 automatic synchronization of a network of cameras, 

automatic annotation of location and time, automatic 
logging of camera use and user. 

NOVELTY COMPARED TO EXISTING DEVICES 

Current surveillance cameras include those which 
10 incorporate built-in ID numbers, clocks and frame 

numbers, and keypads which allow the location to be 

input via keypad with all that data annotated 

onto the resulting single frame or video imagery. 

The resulting imagery can be encrypted or scrambled 
15 prior to transmission, and authorized recipients can 

decrypt or descramble the imagery. Annotation can be 

applied before or after encryption. 

Other authentication or counterfeit detection 

techniques have been developed to place 
20 authenticating information into an image such that it 

is not obvious, and cannot be removed without leaving 

indication of that process. 

The present invention, however, offers the 

novelty of utilizing GPS and GMT receivers for 
25 automatic determination of time and location which is 

not prone to human error or manipulation. It also 

offers the preferred use of FlashCorrelation® for 

rapid readout and authentication of all encoded 
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information, or of any one or more elements. That 
provides the capability to separately control who has 
the ability to determine certain information about 
received images . 
5 The use of Date/time and Location information as 

keys or seeds to the encoding and encryption 
processes ensures non-repetition of those elements; 
increasing the security of the system. By designing 
these modules into the EIS, the devices can be sealed 

10 at the factory and then installed anywhere for 

automatic operation. Alternately, they can be 
manually operated at various locations without any 
user controls other than turning the system on and 
triggering the image taking. 

15 This greatly simplifies the training needed, 

improves the chain of custody of the collected 
information, standardizes the technique for 
authentication, and allows the automated use of the 
system in emergency situations, such as recording 

20 vehicle crashes. 

BRIEF DESCRIPTION OF THE DRAWINGS 

The foregoing and other objects, aspects and 
advantages will be better understood from the 
following detailed description of a preferred 
25 embodiment of the invention with reference to the 

drawings, in which: 

Figure 1 is a flow chart of the imaging and 
encoding method of the invention. 
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Figure 2 is a flow chart of the decoding and 
authentication method of the invention. 

Figure 3 is a schematic of an evidentiary 
imaging subsystem. 
5 Figures 4a, 4b, 4c, and 4d are encoding layers 

formed by using a grey scale pseudorandom number 
generator with the values of the date/time, location, 
camera ID, and frame #, respectively, used as seeds. 
Figure 4e is the composite encoding formed by 
10 superimposition of the four encoding layers 4a, 4b, 

4c and 4d. 

Figures 5a, 5b and 5c illustrate a captured 
image, the composite encoding of authentication data, 
and the overlay of the encoding and the image, 
15 respectively. 

Figures 6a, 6b and 6c show an encryption of the 
encoded image, annotation information, and the 
annotated scrambled encoded image, respectively. 

Figure 7 is a schematic for the Evidentiary 
20 Imaging System receiving and authentication 

subsystem. 

Figures 8a and 8b illustrate the +/+ and +/- 
FlashCorrelation®, respectively, of a date/time 
encoding and the encoded image. 

25 Figures 9a and 9b illustrate the +/+ FCA and +/- 

FCA between the encoded image and the encoding formed 
of the date/time and location information. Figure 9c 
illustrates the -f/- FCA when the encoded image is 
FlashCorrelated with an encoding formed from the 

30 date/time, location, camera ID, and frame #. 
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DETAILED DESCRIPTION OF A PREFERRED 
EMBODIMENT OF THE INVENTION 



Referring now to the drawings, and more 
particularly to Figure 1, there is shown the method 
of encoding by the Evidentiary Imaging System. The 
human operator or an external sensor triggers 101 the 
camera, the GPS and GMT receivers, and the frame 
number incrementing device. 

The camera captures a frame of imagery and 
stores it 102 in the digital image buffer. The frame 
number is incremented and stored 103 in the frame 
buffer. The GMT receiver captures the time and stores 
it 104 in the time buffer. The GPS receiver captures 
the location and stores it 105 in the location 
buffer. The encoder uses the camera ID, frame, 
location, and time to produce an encoding 106 of each 
status information. The composite encoder combines 
the encoding layers to form a composite encoding 107. 
The image encoder combines the image and the encoding 
to produce the encoded image 108. The encrypter 
encrypts the encoder image to produce the encrypted 
encoded image 109. The location processor compares 
110 the GPS information in the location buffer to 
entries in a look-up table. If a match is found, an 
alphanumeric input is provided to the annotator. If 
no match, the location buffer information is provided 
to the annotator. The annotator overlays 111 the 
location information, date/time, camera ID, and frame 
# in alphanumeric form onto the encrypted encoded 
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image. The resultant image is transmitted, output, 
or stored 112. 

Figure 2 illustrates the method of decoding and 
authentication of an image. The resultant image is 
5 obtained 201. The annotation is stripped 202 and the 

annotation information is used to label the image 
file, and may also be used to sort or categorize the 
image, and to indicate the decryption key. The 
resultant image which has been stripped of the 

10 annotation is decrypted 203 using keys obtained from 

the annotation. The output is the encoded image. 
The image is decoded by using the information 
obtained from the annotation, or by exhaustively 
attempting each possible decoding 204. If the 

15 encoding matches the annotated information, or 

matches a possible encoding in the case of non- 
annotated imagery, the image is ruled authentic 206. 

If the encoding does not match the annotated 
information, or does not match any possible encoding 

20 in the case of non-annotated imagery, the image is 

ruled non-authentic. If the image is determined to 
be authentic, the encoding is removed to yield the 
original image 207 by reversing the steps used to 
apply the encoding. If this process leaves voids or 

25 unspecified pixels in the image, standard image 

processing techniques can be used to fill the voids, 
such as using nearest neighbor fill. The situation 
is considered analogous to bad pixel replacement in 
focal plane array camera imagery. 
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Figure 3 presents the apparatus 300 for the 
evidentiary imaging system. The trigger 301 
activates the imaging system. The image acquisition 
device 317 can be a visual, IR, or other two- 
5 dimensional imaging sensor which produces a single 

frame or sequence of frames and stores the image in 
the image buffer 318. The GMT 302 and GPS 303 
receivers are activated by the trigger 301 and each 
store their received information in their 
10 corresponding buffers, the GMT buffer 304 and GPS 

buffer 305, respectively. The frame number buffer 

306 is a hardware or software element which is 
advanced by the trigger 301. The camera ID buffer 

307 is a hardware or software or firmware element 
15 which is set at the factory and can be read by the 

encoder 308. The location processor 309 includes a 
dedicated microprocessor or software, plus a lookup 
table 310 and means for comparing the location in the 
GPS buffer 305 to items in the lookup table 310. If 

20 a match is found, the lookup table entry is sent to 

the annotator 314. Otherwise, the contents of the 
GPS location buffer 305 is sent to the annotator 314. 
The encoder 308 is a hardware or software element 
which produces a two-dimensional encoding of the 

25 information from the camera ID- buffer 307, frame # 

buffer 306, GPS location buffer, and GMT date/time 
buffers 304. Each item can be used to generate a 
separate two-dimensional pattern, and the composite 
of all the patterns forms the encoding. 
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The primary embodiment uses a pseudorandom 
binary number generator (not shown) which uses the 
information from each buffer as a seed to generate a 
binary pattern of dots. The composite pattern is 
5 formed by overlaying all the dot patterns. The 

encoded image processor 311 combines the encoding and 
the image. The primary embodiment overlays the 
encoding on top of the image. The encryption 
processor 312 encrypts the encoded image and stores 

10 it in the encrypted encoded image buffer 313. Any or 

no encryption process may be used. The annotation 
314 forms a composite of the information to be 
visually displayed on the image and the encrypted 
image to produce the annotated encrypted image, also 

15 called the resultant image, which is stored in the 

resultant image buffer 315. The resultant image 
buffer 315 is connected to a printer, storage, or 
transmission device 316. Movement of the resultant 
image can be automatic or manually controlled. 

20 Figures 4, 5, and 6 illustrate the production of 

resultant images in accordance with the method of the 
Evidentiary Imaging System. Figures 4a, b, c, and d 
are encoding layers formed by using a greyscale 
pseudorandom number generator with the values of the 

25 date/time, location, camera ID, and frame #, 

respectively, used as seeds. The pixels have been 
contrast enhanced for visibility, which results in 
the pixels looking large and all black in these 
figures. Figure 4e is the composite encoding formed 

30 by superimposition of the four encoding layers. 
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Figure 5a illustrates a captured image- 5b is 
the composite encoding shown here full size. 5c is 
the overlay of the encoding and the image. Figure 6a 
shows an encryption of the encoded image, formed by 
5 scrambling the pixels. Figure 6b is annotation 

information. Figure 6c is the annotated scrambled 
encoded image, also called the resultant image. 

Figure 7 presents the apparatus for the 
Evidentiary Imaging System receiving and 

10 authentication subsystem 700, The image receiver 701 

is a hardware device which interfaces with electronic 
storage or a peripheral communications device; it 
captures the resultant image from storage or a 
transmission device. The annotation stripper 702 can 

15 be a dedicated processor or software routine which 

removes the annotated information and forwards it to 
the encoding generator 703. The decrypter 704 is a 
dedicated processor or software routine which 
decrypts the image based upon the encryption routine 

20 which is being used within a particular imaging 

system. The encoded image buffer 705 receives the 
results after decryption. The encoding generator 703 
is a dedicated processor or software routine which 
takes the annotation information, if available, and 

25 produces a two-dimensional encoding. If no annotated 

information is present, the authenticator 706 
accesses a database 707 of all possible variables, 
sequentially producing each possible encoding. 

The authenticator 706 compares the encoding 

30 obtained from the annotation information, or each 
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possible encoding, to the encoded image using 
FlashCorrelation® or other comparison technique. If 
there is adequate correlation between the encoding 
and the encoded image, the image is judged to be 
5 authentic and that decision 708 is output. If there 

is not adequate correlation, that decision 708 is 
also output. The image decoder and restoration 
processor 709 is a dedicated processor or software 
routine which removes the encoding from the image and 
10 restores pixels which have become voids in the 

process. The resultant image is made available in 
the restored image buffer 710 to be transmitted, 
stored, or output 711, along with the authentication 
certificate . 

15 Figure 8a illustrates the +/+ FlashCorrelation® 

of a date/time encoding and the encoded image. The 
presence of the rings FlashCorrelation® artifact (+/+ 
FCA) indicates that date/time encoding was used to 
form the encoded image. The fact that the rings 

20 extend everywhere indicate that there has been no 

modification to the encoded image in any part of the 
image. Figure 8b illustrates the +/- 
FlashCorrelation® of the same date/time encoding and 
encoded image. The presence of the high density spot 

25 FlashCorrelation® artifact (+/- FCA) in the center 

indicates that date/time encoding was used to form 
the encoded image. 

It may be difficult in some cases to confirm the 
presence of the +/+ FCA over the entire image plane. 

30 Alternately, the +/- comparison can be performed with 
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the encoded image and the encoding each divided into 
an array of cells. The presence of a +/- artifact in 
each cell would indicate that no modification has 
occurred in each cell. The absence of an artifact in 

5 any cell would indicate that modification has been 

performed in that area of the encoded image. 

Figures 9a and 9b illustrate the +/+ FCA and +/- 
FCA between the encoded image and the encoding formed 
of the date/time and location. The presence of the 

10 FCAs indicates that both the date/time and location 

used to form this encoding were the same ones used in 
the imaging system. Figure 9c illustrates the +/- 
FCA when the encoded image is FlashCorrelated with an 
encoding formed from the date/time, location, camera 

15 ID, and frame #. The presence of the FCA indicates 

that all those parameters chosen for the decoder 
match the same values used in the imaging system. 

The Primary Embodiment of the invention is a 
Vehicle Incident Recording System (not shown) which 

20 uses an infrared camera as the imaging sensor and 

incorporates date/time, location, camera ID, and 
frame number ID encoding with annotation of this same 
data into an image header. The camera is mounted in 
the front grill of the automobile and may be also 

25 used to provide realtime night driving aid to the 

driver. Imagery from the camera is transmitted by 
wireline to the EIS which is located in a relatively 
crash-proof area of the vehicle. The EIS can be 
activated by one or more sensors such as an 

30 accelerometer circuit designed to detect braking or 
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sharp turns, or by air bag inflation. Or it could be 
activated by sensors monitoring driver behavior. 
Alternately^ the EIS can maintain an "endless loop" 
of encoded images associated with a preceding period 
5 of time. The EIS Resultant Imagery would be used for 

accident reconstruction, or to evaluate the 
performance of vehicle operators. 

A Second Embodiment (not shown) addresses the 
market for automatic date/time annotation alone. 

10 This simplest embodiment covers the incorporation of 

a GMT receiver with a camera, resulting in an EIS 
which provides annotation of date and time onto the 
resulting static or video images. This simplest 
consumer version of the EIS omits the encryption, 

15 limits the encoding to just date/time and camera. ID, 

and provides for visible annotation as a selectable 
option. The consumer version would still be useful 
for recording insurance damage, documenting 
accidents, imaging the condition of items offered for 

20 sale, protecting ownership of original art and video 

creations, documenting will and contract signing, and 
other uses. However, the imagery would be presented 
in the clear; that is not encrypted. It therefore 
offers authentication capability but not privacy when 

25 the images are transferred. The decoding keys would 

remain with the EIS supplier, who would offer 
authentication services for a fee when it was 
desired. The EIS user would have proof of ownership 
of any resulting imagery. 
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An advanced version of the Second Embodiment has 
both GMT and GPS receivers, and incorporates a list 
of locations and a processor which enables them to 
annotate alphanumeric text instead of geographical 
5 coordinates for location. It can include a processor 

which takes the GPS data and interprets it to the 
closest location in a list, thereby annotating a 
country/city/street or landmark designation rather 
than geographical coordinates onto the image. 

10 A Third Embodiment (not shown) provides for 

secure transmission of imagery over the internet or 
other network. The sender submits his personal ID, 
the ID of the intended recipient and the image to be 
transmitted. The system encodes his ID and that of 

15 the recipient and may also encode the date and time 

and ID of the transmitting node into an Encoded Data 
Array. It scrambles the image using a scrambling 
algorithm key comprised of the sender ID, recipient 
ID, date and time. It then superimposes the Encoded 

20 Data Array and transmits the Resultant. At the 

receiving end, the system sorts incoming messages by 
searching for the ID of each possible recipient, 
addressing each message to the recipient whose ID 
produces an EGA. The recipient considers all those 

25 senders whose ID code it knows and whose 

transmissions it wishes to receive. It generates the 
set of Encoded Data Arrays corresponding to those 
personal IDs and tests them against the received 
Resultant. If there is a match evidenced by an FCA, 

30 it then descrambles the image, using the transmitted 
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date and time to complete the key. If the exact time 
is unknown, it exhaustively considers various times, 
testing each for an FCA against the Resultant. 

A Fourth Embodiment is an evidentiary imaging 
5 system with provision for determining that a given 

image was in fact produced by a particular camera at 
a particular location and time, and that the image 
has not been altered. Each data item: camera ID, 
location, date, and time can be separately confirmed 

10 by a search for an FCA when the encoding of that data 

item is f lashcorrelated against the Resultant Image. 
For the image to be authentic and not altered, the 
Resultant Image and each of the Encoded Data Arrays 
is divided into cells, and each pair of corresponding 

15 cells is f lashcorrelated. A perfect or at least 

strong FCA, depending upon the level of system noise 
to be tolerated, must occur for each cell. Multiple 
iterative tests can be performed by varying the FCA 
parameters, in particular the angle of rotation 

20 between the encoding image and the Resultant image. 

Since FlashCorrelation® is a sampling technique, use 
of a range of parameters for testing authenticity 
helps to defeat adversaries who would attempt to make 
minor pixel-by-pixel modifications to an encoded 

25 image, hoping that their minor modifications would 

not be significant enough to be discovered. 

Other embodiments of the EIS will include those 
listed above as applications. 

While the invention has been described in terms 

30 of a single preferred embodiment, those skilled in 
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the art will recognize that the invention can be 
practiced with modification within the spirit and 
scope of the appended claims. 
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